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CHAPTER  I 


INTRODUCTION 

In  response  to  changing  military  threats  and 
mission  requirements,  the  Department  of  Defense  (DOD) 
purchases  a  wide  variety  of  complex  systems  from  industry. 

To  assure  that  industry  develops  and  produces  systems  that 
are  adequate  to  meet  defense  needs,  DOD  contracts  with 
industry  often  include  a  Statement  of  Work  (SOW) . 

The  purpose  of  the  SOW  is  to  communicate  to  the 
contractor  the  tasks  and  requirements  that  the  Government 
wishes  the  contractor  to  perform  (16).  The  SOW 
serves  as  a  definitive  reference  for  what  the  Government 
and  the  contractor'  agree  that  the  contractor  is  to  do  and  the 
Government  is  to  pay  for.  A  SOW  is  thus  distinguished  from  a 
specification:  "The  System  Specification  must  be  a  complete 
set  of  minimum  performance  requirements.  .  .[20],"  of  the 
developmental  hardware,  and  software,  e.g.,  mission,  weight, 
size,  speed,  range,  accuracy,  etc.  The  specification 
describes  how  the  system  hardware  and  software  being  purchased 
must  perform.  The  Statement  of  Work,  in  contrast,  describes 
how  and  what  the  contractor  must  perform,  generally: 
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(a)  the  generic  nature  of  the  tasks  to  satisfy 
specification  requirements,  i.e.,  design,  tests, 
analyses,  etc.,  .  .  .  (b)  identification  of 
contractor  obligations  to  the  Government  for 
formal  reviews  and  day-to-day  working  relation¬ 
ships;  and  (c)  identifications  of  necessary  plans 
.  .  .which  must  be  conducted  by  the  contractor 
[20]. 

Some  examples  of  the  type  of  tasks  or  requirements 
expressed  in  the  SOW  are  reliability  and  performance  tests, 
quality  assurance  programs,  management  systems  and  data, 
cost  and  schedule  reports,  and  maintainability  programs. 


Problem  Statement 

Many  problems  encountered  in  DOD  system  contract 
efforts  are  attributed,  in  part,  to  the  failure  of  the 
contract  Statement  of  Work  to  successfully  communicate 
the  Government's  requirements  to  the  contractor. 

SOW  communication  is  the  activity  of  Government 
requirements  being  transmitted  by  a  SOW  and  received  by  a 
contractor.  Successful  SOW  communication  is  the  event  of 
SOW-transmitted  Government  requirements  being  received  and 
interpreted  by  a  contractor  as  the  Government  intended. 

The  process  of  DOD  system  acquisition  would  be 
improved  by  a  knowledge  of  the  factors  that  contribute  to 
successful  SOW  communication  and  the  relative  importance  of 
these  factors. 
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Scope  of  Research 

DOD  systems  are  acquired  through  a  cycle  of 
logical  phases  that  are  prescribed  by  the  DOD  5000 
series  of  directives  (Figure  1 ) .  Each  phase  has  unique 
characteristics  and  requirements.  The  contract  Statement 
of  Work  for  each  phase  must  be  written  with  these 
characteristics  and  requirements  in  mind  (2) .  As  the 
system  progresses  through  each  phase,  the  requirements 
become  more  specific,  technical  freedom  gives  way  to 
management  constraint;  uncertainty  is  reduced  and  the 
Government  frequently  exerts  increasing  control  over  the 
contractor ' s  activities . 

The  Full  Scale  Engineering  Development  (FSED) 
phase  is  characterized  by  moderate  uncertainty;  "some 
unanticipated  unknowns  may  be  encountered,  but  the  level 
of  the  knowns  in  the  uncertainty  continuum  has  increased 
[5:14]."  J.R.  Fox  cites  six  prerequisites  that  mark  the 
beginning  of  FSED: 

1.  Primarily  engineering,  rather  than  experimental, 
effort  is  required. 

2.  The  mission  and  performance  envelopes  are 
defined. 

3.  The  best  perceived  technical  approaches  have 
been  selected. 

4.  A  thorough  trade-off  analysis  has  been  made. 

5.  Cost  effectiveness  for  the  proposed  weapon 
system  and  competing  systems  within  the 
Defense  Department  have  been  compared,  and 
the  proposal  is  considered  feasible. 

6.  Cost  and  schedule  estimates  are  credible  and 
acceptable.  [9:16]. 
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There  is  a  noticeable  increase  in  the  level  of  participation 
in  system  program  mangement  activities  by  many  organizations 
outside  the  program/acquisition  management  office,  e.g.,  the 
system  user  organization,  logistics,  training,  safety,  test, 
and  engineering  organizations.  Their  participation  is 
essential  to  sound  technical  and  management  decisions,  but 
the  interaction  of  these  various  functional  disciplines 
causes  communication  to  be  a  very  complex  activity.  This 
complexity  of  communication  renders  PSED  the  phase  of  the 
acquisition  cycle  where  successful  SOW  communication  is 
probably  the  most  difficult  to  achieve.  The  imperatives 
of  the  functional  disciplines  often  conflict  with  each 
other,  making  the  Statement  of  Work  most  difficult  to 
write  at  the  time  it  is  most  important  to  successful 
completion  of  system  development.  FSED  is  the  final 
determinant  of  successful  new  system  production.  A 
significant  portion  of  defense  research  and  development 
dollars  are  spent  in  FSED. 

In  light  of  the  complexity  of  the  FSED  phase  and 
the  difficulty  of  obtaining  successful  communication  through 
FSED  SOWs,  FSED  was  considered  a  fruitful  starting  point 
for  research  into  successful  SOW  communication.  The  scope 
of  this  research  was  therefore  limited  to  FSED  SOWs. 
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CHAPTER  II 


BACKGROUND 

The  SOW  in  the  FSED  Phase  Contract 

Chapter  I  provided  an  introduction  to  the  Statement 
of  Work  and  the  difficulty  of  writing  a  SOW  during  the  FSED 
phase  of  system  acquisition.  A  complete  understanding  of 
successful  FSED  SOW  communication,  however,  requires  an 
understanding  of  the  SOW  as  an  FSED  contract  document. 

Like  all  system  acquisition  cycle  phases,  FSED 
is  implemented  by  one  or  more  contracts.  Each  contract  is 
generated  and  managed  in  a  standard  sequence  of  steps 
(Figure  21s  requirements  generation,  planning-, 
offer  and  evaluation  and  contract  management  (16).  The 
SOW  is  developed  and  written  early  in  this  process,  during 
requirements  generation  (16),  and  provides  a  description 
of  contractor  tasks  throughout  the  remaining  steps. 

The  SOW  provides  a  part  of  the  baseline  from  which 
contract  funds  requirements  are  estimated.  These  estimates 
determine  the  dollar  level  of  the  purchase  request  which 
marks  the  beginning  of  the  planning  step. 

During  planning,  the  SOW  remains  the  major  description 
of  what  the  Government  expects  of  a  potential  contractor. 

Much  of  the  planning  takes  place  according  to  what  is  in  the 
SOW. 
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REQUIREMENTS  OFFER  AND  CONTRACT 

GENERATION  PLANNING  EVALUATION  MANAGEMENT 
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The  SOW  is  an  essential  element  of  the  Government 
solicitation  of  potential  contractors,  usually  accomplished 
through  the  Request  for  Proposal  (RFP) .  "The  first  attempt 
to  translate  precontract  activity  into  a  communication  to 
industry  [7:9],"  the  RFP  functions  to  "obtain  a  legal  and 
binding  offer  to  perform  from  a  prospective  contractor 
[11:2,3] ." 

The  issuance  of  the  RFP  marks  the  beginning  of  the 
offer  and  evaluation  step  of  the  contracting  process,  during 
which  the  Government  selects  its  contractor.  Offerors 
respond  to  the  RFP  with  proposals  describing  the  technical, 
management  and  cost  conditions  under  which  they  are  willing 
to  perform  the  Government's  requirements. 

The  SOW  is  the  major  description  of  requirements 
in  the  RFP  for  the  potential  contractor.  The  SOW  must 
communicate  the  technical  requirements  of  engineers  and 
the  management  requirements  of  many  specialists,  while 
"permitting  close  estimation  of  the  economic  resources 
needed  to  fulfill  these  requirements  [11:1].”  From  what 
the  SOW  communicates  to  the  offerors,  the  offerors  estimate 
costs  and  develop  proposals.  It  is  therefore  imperative 
that  the  SOW  be  well  organized  and  communicate  clearly 


After  receipt  of  offers  from  industry,  the 
Government  evaluates  the  offers  for  the  combination  of 
technical,  management,  and  cost  considerations  most 
advantageous  to  the  Government.  Generally,  system 
acquisitions  are  of  the  complexity  and  dollar  value 
that  require  the  selected  offer  to  be  negotiated  Cl  6). 
During  negotiation,  the  SOW  that  was  included  in  the 
RFP  may  undergo  many  changes  as  Government  and  offeror 
arrive  at  a  mutually  acceptable  combination  of  require¬ 
ments  and  price.  The  original  SOW  remains  the  framework 
for  the  negotiated  SOW  (SOWs  are  amended  but  rarely 
rewritten);  thus,  the  ability  of  the  negotiated  SOW 
to  successfully  communicate  Government  requirements 
is  very  dependent  on  the  original  SOW's  ability  to  do 
so. 

Following  successful  negotiations,  the  Government 
awards  a  contract  to  the  offeror  (now  contractor) .  The 
contract,  simply  defined,  is  "an  enforceable  agreement 
entered  into  by  two  legally  equivalent  persons  [12:3,4]." 
The  negotiated  SOW  is  an  integral  part  of  that  contract. 
Therefore,  the  SOW  must  be  "complete  and  legally 
enforceable  [10:1]."  The  SOW  should,  however,  convey  only 
those  requirements  that  are  not  accommodated  in  the  other 
parts  of  the  contract  (23) . 
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During  the  contract  management  step  (generally  the 
longest  of  the  steps 1  contractor  performance  is  compared 
with  the  SOW  for  sufficiency.  The  SOW  here  serves  as  a 
record  of  what  the  Government  and  contractor  understand  the 
requirements  to  be.  When  the  requirements  are  completed, 
the  SOW  is  often  used  as  an  acceptance  document  (11:3). 

The  SOW  thus  plays  an  extended  and  versatile  role 
through  the  entire  contracting  process  during  FSED .  The 
importance  of  the  SOW  is  officially  recognized  in  the 
primary  controlling  regulation  of  DOD  contracting,  the 
Defense  Acquisition  Regulation  (DAR) :  "The  preparation 
and  use  of  a  clear  and  complete  Statement  of  Work  is 
essential  to  sound  contracting  for  Research  and  Develop¬ 
ment  [27:4:3]."  Herbert  Howe,  Chief  of  Contract  Admini¬ 
stration  of  the  Air  Force  Plant  Representative  Office, 
General  Electric  Company,  Evendale,  Ohio,  stated  this  in 
more  succinct  terms:  "You  can't  put  out  a  good  contract 
if  you  start  with  a  poor  SOW  [13:1]." 

Research  Justification 

The  importance  of  the  research  was  revealed  by  a 
search  of  existing  knowledge  of  the  problem.  It  was 
shown  that  there  is  a  common  belief  that  SOWs  often  do  not 
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achieve  their  main  purpose,  i.e.,  successful  communication 
of  requirements,  that  there  is  interest  in  solving  the 
problem,  and  that  there  are  potential  benefits  in  a 
solution. 

Problem  Knowledge.  The  knowledge  search  has  shown  that 
few  of  the  sources  of  existing  knowledge  dealt  with  SOW 
communication  per  se.  They  addressed  SOW  problems  in  a 
variety  of  terms:  poor  quality,  length,  redundancy, 
lack  of  uniform  structure,  content,  lack  of  clarity, 
poor  definition  of  requirements,  misunderstandings,  cost, 
schedule  and  performance  problems,  and  claims  against  the 
Government.  These  terms  all  suggest  an  underlying 
problem:  a  failure  of  the  Government  and  the  contractor 
to  successfully  communicate. 

The  specific  results  of  the  knowledge  search  are 
discussed  in  the  next  two  sections. 

Problem  Existence.  Problems  with  SOW  communication 
of  requirements  have  been  documented  since  the  early 
1970s. 

Research  by  the  Army  Procurement  Research 
Center  in  1973  found  "diversity  of  structure,  and 
lack  of  brevity  and  clarity  [29:iv]"  of  RPPs  and 
the  SOWs  within  them.  A  University  of  Maryland 
unpublished  research  report  indicated  frequent  industry 


dissatisfaction  with,  the  lack  of  clarity  in  the  Government's 
expression  of  requirements  in  RFPs  Cl  51 .  The  Aeronautical 
Systems  Division  (ASD)  of  AFSC  has  documented  similar 
findings;  a  1976  statement  from  the  Directorate  of 
Procurement  and  Production  expressed  concern  over  "contin¬ 
ued  decline  in  the  quality  of  Statements  of  Work,"  citing 
redundance,  vague  language,  and  ambiguities  as  frequent 
problems  that  surfaced  in  contract  reviews  (.23)  . 

An  ASD  study  of  the  status  of  RFPs,  revealed  that 
SOW  requirements  are  frequently  redundant  to  or  in  conflict 
with  other  RFP  or  contract  requirements  such  as  data  items 
and  special  provisions  (.3)  .  A  1977  ASD  study  of  RFP 
improvement  methods  suggested  elimination  of  SOW  duplication 
of  requirements  expressed  in  the  specification  (22:4). 

When  interviewed  by  the  researchers,  several 
officials  at  ASD  indicated  that  these  problems  continue 
to  plague  acquisition  efforts  (4,8,21). 

The  Air  Force  Acquisition  Logistics  Division 
maintains  a  Lessons  Learned  File  that  documents  mistakes 
and  oversights  in  Statements  of  Work  (1). 

The  result  of  these  efforts  has  not  been  remediation 
of  problems  nor  improved  communication.  J.A.  Boykin 
stated  that  the  SOW  "has  evolved  into  a  monster"  that 
invites  duplication  and  contradictions  (3) ,  lending  the 
impression  that  previous  SOW  improvement  efforts  haven't 
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been  successful.  Howe  stated:  "Many  attempts  have  been 
made  to  improve  the  quality  of  the  SOW.  In  my  opinion, 
they  have  not  been  very  effective  £13:1]." 

Problem  Interest.  Interest  in  solving  SOW  communication 
problems  is  not  new.  Staff  studies  at  the  Space  Systems 
Division  indicate  an  interest  in  SOW  quality  as  early  as 
1963  (10).  The  Army  Materiel  Command  commissioned  a  study 
to  improve  work  statement  quality  (26:1,5).  In  1966,  Air 
Force  Systems  Command  (AFSC)  was,  for  similar  purposes, 
drafting  a  work  statement  writing  guide  (AFSCM  70-XX) 
during  this  period  (26:63).  The  Space  and  Missile  Systems 
Organization  of  AFSC  established  a  Statement  of  Work 
review  office  prior  to  its  1979  reorganization. 

Howe  indicated  continued  interest  in  problems  in 
the  acquisition  cycle.  He  suggested  improvements  in  the 
mechanics  of  SOW  writing,  identified  some  of  the  behavioral 
aspects  of  requirements  generation  and  explained  the  roles 
of  the  involved  parties  (10,11,12,13,14). 

Continual  cost,  schedule  and  performance  problems 
with  Air  Force  acquisition  prompted  General  Alton  D.  Slay, 
upon  assuming  the  position  of  Commander,  AFSC,  in  1978,  to 
issue  Commander's  Policy  Letter  Number  22  which,  among 
other  things,  called  for  "clear  delineation  of  the  require¬ 
ment  [2]."  That  letter  was  subsequently  rewritten  as  AFSC 
Regulation  550-22. 
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Research.  Benefits.  This  research  focuses  upon  factors  that 
contribute  to  successful  SOW  communication .  A  knowledge 
of  such  factors  may  enable  acquisition  personnel  to  better 
understand  SOW  communication  and  produce  SOWs  that 
contribute  better  to  communication  success.  SOWs  that 
communicate  successfully  may  contribute  to  the  reduction 
of  cost,  schedule,  and  performance  problems,  and  the 
frequency  and  severity  of  claims  against  the  Government. 

The  knowledge  of  successful  communication  factors  may 
also  provide  an  origin  for  additional  research. 

Research  Objectives 

In  order  to  obtain  a  knowledge  of  factors  for 
successful  FSED  SOW  communication,  the  researchers  focused 
on  two  objectives: 

1 .  To  identify  primary  factors  that  contribute  to 
successful  FSED  SOW  communication  of  requirements. 

2.  To  determine  if  SOW  experts  agree  that  some 
factors  identified  contribute  more  to  successful  communi¬ 
cation  than  others. 

These  objectives  were  structured  as  a  research 
question  and  a  research  hypothesis. 
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Research  Question. 

The  first  research  objective  was  structured  as  an 
exploratory  question:  What  are  the  factors  that  contribute 
to  successful  FSED  SOW  communication? 

Research  Hypothesis. 

The  second  research  objective  was  structured  as  a 
statistically  testable  research  hypothesis:  There  is 
agreement  as  to  the  importance  of  the  factors  identified 
by  the  Research  Question. 
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CHAPTER  III 
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RESEARCH  METHODOLOGY 

The  Statement  of  Work  is  an  important  instrument 
in  contracting  for  major  system  Full  Scale  Engineering 
Development.  It  serves  as  a  primary  medium  of  communi¬ 
cation  of  Government  requirement  to  the  contractor.  Yet, 
it  is  recognized  throughout  the  system  acquisition 
community,  from  top  policy  makers  to  contract  negotiators 
and  administrators,  that  SOWs  frequently  fail  to  secure 
successful  communication  between  Government  and  contractors. 
In  concert  with  the  research  objectives  of  identifying 
factors  that  contribute  to  successful  SOW  communication, 
and  determining  if  some  factors  are  more  important  than 
others,  this  Chapter  explains  the  methods  employed  to 
locate,  secure,  and  analyze  the  data  necessary  to  meet 
the  objectives. 

Data  Source 

"Probably  only  a  very  small  portion  of  existing 
knowledge  and  experience  is  ever  put  into  written  form 
[24:55]."  It  was  therefore  decided  to  survey  the  knowledge 
and  experience  of  personnel  currently  working  with  FSED 
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SOWs.  Knowledge  of  and  experience  with  FSED  SOWs  may  be 
available  in  a  variety  of  organizations  and  disciplines. 
This  research,  however,  was  directed  toward  the 
perspectives  of  contracts  personnel.  Although  personnel 
of  other  disciplines  usually  write  the  SOW,  contracts 
personnel  must  contend  with  the  communications  results 
of  the  SOW  (14). 

These  contracts  personnel  were  approached  first 
to  identify  factors  that  contribute  to  successful  FSED 
SOW  communication,  and  second  to  address  the  order  of 
importance  of  the  collected  factors. 

Many  people  work  in  the  contracts  specialty  but 
not  all  were  capable  of  providing  data  raeaningful  to  this 
research.  It-  was  necessary  to  restrict  the  survey  to 
a  raeaningful  level  of  expertise  in  FSED  SOWs.  This 
was  accomplished  by  establishing  the  following  minimum 
criteria  for  SOW  experts. 

1 .  Thirty  or  more  months  of  total  experience 
in  systems  acquisition.  The  researchers  considered  this 
a  minimum  time  in  which  military  or  civilian  contracts 
personnel  could  become  familiar  enough  with  FSED  programs 
and  SOWs  to  form  reasonable,  generalized  opinions 
concerning  these  subjects. 
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2.  Grade  of  0-2,  GS-11  or  above.  These  grades 
are  above  the  entry  grades  of  0-1  and  GS-09  or  GS-10  that 
typically  are  assigned  to  contracting  and  management 
positions.  The  higher  grades  are  commensurate  with  the 
thirty  months  experience  in  systems  acquisition  required. 

3.  Current  assignment  in  the  disciplines  of 
contracting,  contract  review,  contract  policy,  or  contract 
management . 

4.  Experience  in  more  than  one  DOD  program 

or  work  assignment.  The  researchers  considered  the  breadth 
of  experience  necessary  for  experts  to  develop  general 
opinions . 

5.  Past  participation,  twice  or  more,  in  the 
activities  of  writing  FSED  SOWs  or  writing,  negotiating, 
or  managing  FSED  contracts.  Depth  of  experience  in  FSED 
SOW  or  contract  activities  was  considered  important  to 
meaningful  opinion  formulation. 

Research  Universe 

The  SOW  is  used  as  a  vehicle  of  communication 
in  contracts  for  major  systems  throughout  DOD.  While 
these  systems  differ  in  type  and  purpose,  all  are 
managed  under  the  auspices  of  the  DOD  5000  series  of 
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directives  and  contracted  for  under  the  Defense 
Acquisition  Regulation.  These  regulations  provide  a 
common  operating  philosophy  for  the  entire  research 
universe:  the  set  of  all  FSED  SOW  experts  within  the 
Department  of  Defense. 

Research  Population. 

The  research  population  consisted  of  all  FSED 
SOW  experts  assigned  to  the  Air  Force  Systems  Command, 
Aeronautical  Systems  Division  at  Wright-Patterson  Air 
Force  Base,  Ohio.  In  selecting  this  population,  the 
researchers  considered  the  similarity  of  FSED  program 
management  and  contracting  in  DOD  and  the  time  and 
other  resource  constraints  of-  the  research  project. 

The  resources  available  were  more  productively  expended 
by  focusing  on  a  localized  population  than  topically 
surveying  a  large  population  at  large  geographic 
distances.  Because  all  DOD  systems  acquisitions  must 
conform  to  standard  techniques  of  systems  management 
and  contracting,  the  research  performed  on  the  selected 
population  can  be  generalized  to  the  research  universe. 
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Sampling  Plan 

While  purposive  sampling  is  often  used  for 
experience  surveys,  the  researchers  conducted  a 
random  sampling  to  strengthen  statistical  testing 
of  the  Research  Hypothesis. 

The  Directorate  of  Contracting,  under  the 
ASD  Deputy  for  Contracting  and  Manufacturing  (ASD/PMW) 
maintains  computerized  records  of  ASD  civilian  contracts 
personnel.  The  records  contain  the  grade  and  job  type  for 
each  individual  by  name,  along  with  current  organizational 
assignment.  Similar  data  is  maintained  for  military 
contracts  personnel  in  manual  form.  From  these  records 
a  list  was  generated  of  all  ASD  personnel,  military  and 
civilian,  of  grade  0-2/GS-11  or  above,  employed  in 
contracting,  contract  review,  contract  policy,  or  contract 
management.  This  action  produced  a  list  of  315  personnel, 
an  indefinite  subset  of  which  was  the  research  population. 

The  researchers  sampled  names  from  the  list  and, 
after  initial  contact  to  confirm  the  remaining  criteria, 
selected  only  those  that  met  the  remaining  criteria.  This 
sampling  was  performed  first,  by  numbering  each  name  on 
the  list  in  order,  1-315. 

From  the  table  of  random  numbers  (Appendix  A)  a 
seed  number  was  randomly  drawn.  Beginning  with  the  seed 
number,  the  first  three  digits  of  each  five  digit 
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grouping  was  drawn.  Three  digit  groupings  of  000  and  316 
or  larger  were  discarded.  Groupings  between  001  and  315, 
inclusive,  were  recorded  on  the  first  time  drawn.  Names 
corresponding  to  the  numbers  drawn  were  listed  in  the 
order  of  draw. 

The  randomly  drawn  names  were  discussed  with 
ASD/PMW  managers  to  ascertain  the  time  each  listed  person 
had  spent  in  systems  acquisition.  Those  having  less  than 
thirty  months  experience  were  removed  from  consideration. 

The  remaining  persons  listed  were  contacted  and 
surveyed  as  to  number  of  assignments  held  and  number  of 
FSED  SOWs  or  contracts  worked  with.  Those  having  held 
more  than  one  assignment  and  having  worked  with  two  or 
more  SOWs  or  contracts  were  asked  to  take  part  in  the 
survey . 

This  sampling  method  resulted  in  a  random 
sampling  of  elements  from  the  research  population. 

C.  Selltiz  and  others  point  out  that,  typically 
in  experience  surveys,  as  more  experts  are  surveyed, 
fewer  new  insights  are  obtained  (24:56).  Rather  than 
arbitrarily  limit  the  number  of  experts  surveyed,  the 
principle  of  decreasing  returns  was  employed  in  the 
sample. 
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The  initial  process  of  obtaining  responses  for 
the  Research  Question  determined  the  size  of  the  sample; 
SOW  experts  were  surveyed  for  responses  until  the  point 
that  no  new  responses  were  received.  No  new  data  (of  any 
substance)  was  obtained  at  the  point  that  an  expert 
interview  produced  only  responses  that  had  been 
previously  obtained. 


Research  Question 


Data  Collection  Plan.  The  purpose  of  the  Research 
Question  was  to  explore  and  identify  factors  that  contribute 
to  successful  communication  in  FSED  SOWs.  An  experience 
survey  is  to  gather  and  synthesize  such  experience  (24:55). 
The  experience  survey  of  ASD  FSED  SOW  experts  utilized 
personal  interviews.  A  focused  interview  was  used,  of  the 
type  described  by  Merton,  Fiske,  and  Kendall: 

In  the  focused  interview.  .  .  the  main  function 
of  the  interviewer  is  to  focus  attention  upon  a 
given  experience  and  its  effects.  He  knows  in 
advance  what  topics,  or  what  aspects  of  a  question, 
he  wishes  to  cover.  Although  the  respondent  is 
free  to  express  completely  his  own  line  of  thought, 
the  direction  of  the  interview  is  clearly  in  the 
hands  of  the  interviewer.  He  wants  definite  types 
of  information,  and  part  of  his  task  is  to  confine 
the  respondent  to  discussion  of  the  issues  about 
which  he  wants  knowledge  [24:264]. 

The  interview  guide  in  Appendix  B  was  developed 
and  implemented  for  the  focused  interview.  The  validity  of 
the  guide  was  established  through  trial  interviews  of 
School  of  Systems  and  Logistics  students.  Trial 


respondents  were  selected  on  the  basis  of  having 
met  the  criteria  for  expertise  previously  described. 
Respondent  comments  concerning  the  format  of  the 
interview  were  noted  and  changes  were  made  where 
necessary. 

Design  to  Answer  the  Research  Question.  The  specific 
factors  obtained  from  the  interviews  were  tabulated 
into  a  single  list.  Identical  responses  were  recorded 
only  once.  Responses  that  differed  verbally,  but  were 
the  same  conceptually  were  considered  to  be  the  same 
response.  This  precluded  redundancy  of  factors  in  the 
final  list.  The  final  list  constituted  the  answer 
to  the  Research  Question. 

Research  Hypothesis 

Data  Collection  Plan.  The  Statement  of  Work  experts 
interviewed  for  the  Research  Question  were  contacted  again 
to  provide  data  for  the  Research  Hypothesis.  A  list  of 
factors  coded  from  the  Research  Question  response  list 
was  given  to  each  expert.  Each  was  then  instructed  to 
rank  the  factors  in  order  of  importance  to  successful 
FSED  Statement  of  Work  communication  with  Number  1  being 
the  most  important.  Number  2  the  second  most,  and  so  on. 


Design  to  Test  Research  Hypothesis.  The  rank  ordered 
factors  obtained  constituted  ordinal  level  data.  Ordinal 
level  data  is  data  which  is  characterized  by  some  order. 
The  elements  of  the  data  are  transitively  related,  that 
is,  of  greater  or  lesser  value  to  each  other.  There  is 
no  standard  of  value  implied  to  ordinal  data.  Elements 
are  known  to  be  greater  or  lesser  than  each  other,  but 
without  degree.  Ordinal  data  also  implies  no  origin, 
i.e.,  no  zero  value  (6:113). 

The  lack  of  magnitude  measure  in  the  ordinal 
level  data  prevented  the  effective  use  of  parametric 
statistical  tests.  The  researchers  selected  a  non-para- 
metric  statistical  technique,  applicable  to  ordinal  data, 
for  the  testing.  Specifically,  this  was  Kendall's 
Coefficient  of  Concordance  (ar)  (24:229-238).  The 
Coefficient  of  Concordance  is  a  measure  of  the  degree 
of  agreement  between  k  raters  (experts)  ranking  n  items. 

A  summary  of  the  mechanics  of  the  Kendall  w  is  found  in 
Appendix  C. 

The  null  hypothesis  {.hq)  was  that  there  was  no 
significant  agreement  between  experts  as  to  the  order  of 
importance  of  the  factors  to  successful  SOW  communication. 
The  alternate  hypothesis  (h^)  was  that  there  was  a  signi¬ 
ficant  agreement  between  experts. 


The  decision  rule  for  the  test  depended  upon  the 
critical  Kendall  w  value  and  the  number  of  factors  rated 
(n) .  The  significance  of  .05  was  assumed  for  the  hypothesis 
test. 

Two  decision  rule  formats  were  possible ,  depending 
on  the  size  of  w.  For  N  less  than  or  equal  to  7,  the 
decision  rule  would  have  been  based  on  critical  values  of  wi 

If  w  <  it  ...  . ,  conclude  h 

critical  o 

If  tt  >  w  ...  , ,  reject  h  ,  assume 

If  the  critical  value  of  tt  (Appendix  C)  was  greater  than 
the  ft  determined  from  the  sample,  there  would  have  been 
no  statistical  basis  to  believe  that  the  agreement 
between  experts  was  anything  more  than  random,  i.e., 
there  would  have  been  no  agreement.  If  w  was  greater  than 
or  equal  to  the  critical  ft  value,  however,  there  would 
have  been  sufficient  statistical  evidence  to  indicate 
that  some  process  or  pattern  of  agreement  was  present. 

Thus  the  null  hypothesis  would  have  been  rejected  and  the 
alternate  hypothesis  accepted. 

For  s  greater  than  7,  the  decision  rule  would  have 
been  based  upon  a  comparison  of  a  weighted  ft  approximation 
of  the  x2  distribution  with  the  actual  x2  distribution 
at  (ff-l)  degrees  of  freedom: 

If  significance  of  x2  =  k(N-1)W  was  greater  than 

.05,  conclude  a 


If  significance  of  x2  =  k(N-1)W  was  less  than  or 
equal  to  .05,  reject  assume  h2 

If  the  critical  x2  value  at  (w-l)  degrees  of  freedom  was 
associated  with  a  significance  value  greater  than  .05  (i.e., 
of  lower  confidence)  there  would  have  been  no  basis  for 
assuming  any  agreement  other  than  random.  A  value  less 
than  or  equal  to  .05  would  have  indicated  rejection  of  the 
assumption  of  no  agreement. 

Limitations  and  Assumptions 

Existing  limitations  and  necessary  assumptions, 
as  specified  below,  affected  the  research  design: 

Limitation  No.  1.  No  definitive  list  of  ASD 
SOW  experts  existed. 

Limitation  No .  2 .  Researcher  interpretation  of 
Research  Question  responses  was  necessary  to  avoid 
redundancy . 

Assumption  No.  1.  Contracting  methods  and  SOW 
communication  among  00D  contracts  are  similar. 

Assumption  No.  2.  Experts  were  most  likely  found  in 
contracting,  contract  review,  management,  and  policy  organi¬ 
zations. 
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CHAPTER  IV 


DATA  COLLECTION  AND  ANALYSIS 

This  chapter  provides  the  results  of  the  data 
collection  described  in  the  Research  Methodology  chapter. 
Also  provided  are  analyses  of  the  Research  Question  and 
Research  Hypothesis. 

Sample  Results 

The  number  of  interviews  performed  for  Research 
Question  data  collection  depended  upon  the  receipt  of 
new  responses.  When  interviews  ceased  to  yield  new 
responses,  interviewing  was  terminated. 

A  list  of  factors  was  generated  from  the  focused 
interviews.  As  each  new  interview  was  completed,  the 
factors  resulting  from  that  interview  were  compared  with 
those  already  on  the  list.  Those  new  factors  that  were 
not  duplicates  of  those  already  on  the  list  were  added  to 
the  list. 

As  more  interviews  were  conducted,  fewer  new 
factors  appeared.  The  fifteenth  interview  produced  no 
new  factors.  Interviewing  for  the  Research  Question 
was  then  terminated. 


Research  Question  Results 

The  fifteenth  interview  with  PSED  SOW  experts 
resulted  in  a  list  of  twenty-five  distinct  factors  that 
bear  upon  the  success  of  SOW  communication.  This  list, 
together  with  similar  discriptors  and  explanatory 
observations  gleaned  during  the  interviews,  where 
applicable,  follows.  The  order  of  the  listing  does  not 
reflect  importance  or  frequency  of  occurrence  for  the 


response. 

1 .  Clear,  unambiguous  definition  of  requirements. 
Requirements  were  viewed  as  tasks  performed  by  the 
contractor.  Interviewees  were  concerned  that  require¬ 
ments  should  be  complete  and  specifically  stated  in 
mutually  understood,  measurable  criteria. 

2 .  Sincere,  realistic  requirements.  Require¬ 
ments  should  be  technically  feasible.  Some  respondents 
observed  that  requirements  are  at  times  written  in 
expectation  that  the  contractor  will  not  reach  the 
specified  performance  level,  i.e.,  with  the  intent  to 
"challenge"  the  contractor.  It  was  perceived  that 
contractors  are  aware  of  the  lack  of  realism 
expressed  in  such  requirements  and  take  them  no  more 
seriously  than  those  levying  the  requirements. 


3.  Critical  requirements  distinguished  from 
non-critical  requirements.  Respondents  were  concerned 
that  the  priority  of  requirements  should  be  specifically 
stated.  "Nice-to-have"  tasks  should  be  distinguished 
from  "must-have"  tasks. 

4.  Variable  (trade-off)  requirements 
distinguished  from  absolute  requirements.  Absolute 
requirements  should  be  stated  in  firm  quantitative  terms. 
Requirements  that  may  be  subjected  to  trade-offs  between 
each  other  should  be  so  identified  with  acceptable 
quantitative  ranges . 

5.  Graphic s/visual  descriptions  used  when 
appropriate .  Some  requirements  can  often  be  more  clearly 
expressed  through  the  use  of  schedules,  diagrams,  or 
drawings . 

6.  Incorporated  documents  tailored  to 
requirements .  Requirements  expressed  in  documents  such 

as  military  standards  or  specifications  should  be  modified 
to  fit  the  particular  SOW  in  which  they  are  incorporated. 
Several  respondents  commented  that  standards  and 
specifications  are  often  incorporated  without  review  and 
that  many  requirements  levied  upon  the  contractor  are 
vague,  unnecessary,  or  meaningless. 
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7. 


Terminology  consistent.  The  same  term  or 


description  that  refers  to  a  task  or  concept  should  be 
used  throughout  the  SOW.  Clarity  should  have  precedence 
over  variety. 

8 .  SOW  statements  non-contradictory.  Statements 
in  the  SOW  should  be  compatible  with  each  other;  require¬ 
ments  should  not  conflict. 

9.  Easy  to  read/use  paragraph  numbering  system. 
Some  paragraph  numbering  systems  can  confuse  through 
similarity  and  number  of  characters  and  that  such  systems 
should  be  avoided. 

10.  Consistent  format  and  organization  in  SOW 
document .  The  SOW  format  should  be  the  same  throughout. 

1 1 .  SOW  logically  organized.  The  SOW  should  be 
organized  so  that  requirements  are  presented  in  a 
predictable,  non-dis jointed  manner. 

12.  SOW  paragraphs  reference  Contract  Data 
Requirements  List  (CDRL) .  SOW  paragraphs  often  prescribe 
tasks  that  directly  or  indirectly  generate  data  items. 
Several  respondents  considered  it  beneficial  to  reference 
the  paragraph  to  the  contractual  data  requirement  in  the 
CDRL. 
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13.  SOW  paragraphs  reference  other  contract 
documents .  Similar  to  CDRL  references,  some  respondents 
believed  it  beneficial  for  the  pertinent  SOW  requirement 
to  reference  other  contract  documents  by  section  or  para¬ 
graph  where  such  information  will  bear  on  understanding 
or  performance  of  that  SOW  requirement. 

14.  Terms  and  acronyms  defined.  SOW  writers 
should  not  assume  that  everyone  reading  the  SOW  under¬ 
stands  the  terms  and  acronyms  used  nor  that  they  under¬ 
stand  terms  and  acronyms  consistently. 

15.  Concise  Language.  Requirements  should  be 
expressed  in  as  few  words  as  possible. 

16.  Clear,  precise  language.  Language  and 
style  should  be  readily  understood.  Modifiers  should 
be  used  to  define  requirements  as  opposed  to  expanding 
them.  Descriptors  should  be  in  measurable  criteria; 
superlatives  should  be  avoided. 

17.  Draft  SOW  reviewed  and  commented  on  by 
contractor.  Respondents  favored  contractor  review  and 
comment  on  the  draft  SOW  and  other  draft  RFP  documents. 

1 8 .  Government-contractor  exchange  meetings 
held  concerning  the  draft  SOW.  Respondents  favored 
meetings  between  Government  and  contractor  management  and 
functional  discipline  counterparts. 
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19.  Development/writing  of  SOW  accomplished 
by  integrated  Government  effort.  The  SOW  should  be 
developed  and  written  by  an  integrated,  coordinated 
team  of  Government  functional  representatives. 

20.  Leadership  of  SOW  writing  effort.  Most 
respondents  identified  the  program  or  project  manager 
as  the  individual  who  should  exert  leadership  in  the 
SOW  development  and  writing  efforts.  Additional 
suggestions  for  the  leadership  role  were  the  buyer/ 
contracting  officer  and  the  chief  engineer  or  systems 
engineer . 

21 .  Individual  functional  office  comprehension 
of  program  objectives  and  requirements.  Government 
functional  specialists  should  be  made  aware  of  the 
primary  program  goals  emd  requirements/SOW  tasks. 

22.  SOW  reviewed  by  Government  contracts  office. 
The  SOW  should  be  reviewed  by  the  contracting  office. 

23.  Internal  Government  review  of  SOW.  The 
Government  should  review  the  SOW  prior  to  placing  it 
on  contract  if  the  SOW  was  con tractor -developed. 

24.  User  agency  participation  in  SOW  development, 
writing.  Agencies  that  will  use  the  system  should 
participate  in  the  development  and  writing  of  the  SOW. 
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25 .  Program  manager  guidance  to  the  team. 

The  program  manager  should  provide  program  background  and 
acquisition  strategy  to  the  Acquisition  Team  Members. 

Research  Hypothesis  Data  Collection 

The  twenty-five  Research  Question  responses 
exhibited  some  obvious  similar  themes  and  concerns. 

To  emphasize  major  subjects  during  hypothesis  testing, 
the  researchers  elected  to  code  the  twenty-five  responses 
into  categories. 


Coding  for  Hypothesis  Testing.  The  coding  process  did  not 
lend  itself  to  extensive  pre-planning.  The  researchers 
resorted  to  inductive  coding,  a  technique  described  by 
D.  and  C.  Nachmias: 

In  exploratory  research  or  in  pilot  studies, 
data  are  collected  without  a  predesigned  system  of 
categories.  Therefore,  the  coding  scheme  is  con¬ 
structed  on  the  basis  of  raw  material. 

The  inductive  method  is  most  frequently  applied 
to  coding  responses  to  open-ended  questions  or  to 
data  obtained  from  documents  or  through  the  method 
of  participant  observation. 

With  the  inductive  method  of  coding,  the  first 
step  is  to  select  a  representative  sample  of 
responses  .  .  .  When  the  selection  is  sufficiently 
large  and  varied  for  a  pattern  to  emerge,  the  coding 
scheme  can  be  constructed.  This  preliminary  scheme 
is  then  systematically  applied  to  the  data. 

Categories  are  not  always,  easily  identified. 
Often,  the  process  of  constructing  a  coding  scheme 
is  a  long  one  and  involves  switching  back  and  forth 
between  the  raw  data  and  the  evolving  scheme  until 
the  latter  is  applicable  and  ties  in  with  the  general 
purpose  of  the  study  [18:145-146]. 
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In  accordance  with  the  inductive  technique,  the  twenty-five 
responses  were  first  searched  for  salient  common  subjects  to 
be  used  as  coding  categories.  Seven  emerged: 

1 .  Requirements 

2.  Consistency 

3.  Internal  Document  Organization 

4 .  Contract  Cross-referencing 

5 .  Language 

6.  Contractor  Participation 

7.  Government  Personnel  Team  Effort 

Following  establishment  of  this  coding  scheme,  each  of  the 
twenty-five  responses  was  assigned  to  the  most  appropriate 
of  the  seven  categories.  The  results  of  the  coding  are 
shown  in  Appendix  E  and  reflect  the  coding  judgment  of  the 
researchers.  This  is  in  concert  with  typical  conditions  for 
inductive  coding  as  described  by  Nachmias  * : 

In  coding  open-ended  questions  or  non-structured 
material,  coders  are  required  to  exercise  their  own 
judgment  in  classifying  responses  according  to  the 
coding  scheme  [18:150] . 


Test  Instrument.  A  statement  was  written  about  each  of  the 
seven  categories.  These  statements  were  then  arranged  in  a 
random  order  to  preclude  bias  of  presentation  in  the 
Research  Hypothesis  test  instrument.  The  test  instrument, 
"FSED  Statement  of  Work  Priority  Survey,"  is  shown  in 
Appendix  F. 
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The  instrument  was  validated  through  trial 


surveys  of  Graduate  Logistics  Program  students  at  the 
School  of  Systems  and  Logistics.  Comments  were  noted 
and  changes  to  the  survey  format  were  made  where  necessary 

Research  Hypothesis  Results 

The  responses  from  the  Research  Hypothesis 
were  arranged  in  matrix  format  and  are  displayed  in 
Appendix  G. 

Appendix  G  also  shows  the  sums  of  the  ranks  R  ^ 
for  each  of  the  columns  of  ranks. 

The  Kendall  Coefficient  of  Concordance  (w)  was 
used  to  test  the  Research  Hypothesis  that  there  is 
agreement  between  the  experts.  The  formal  hypothesis 
test  structure  was  as  follows: 

H  :  There  is  no  significant  agreement  between 
experts  as  to  the  importance  of  the  factors 
upon  successful  SOW  communication. 

H. :  There  is  significant  agreement  between 
experts . 

The  format  for  the  decision  rule  employed  was 
dependent  upon  the  number  of  factors  w  ranked  by  the 
fifteen  experts.  The  W"7  factors  ranked  indicated  the 
use  of  the  following  decision  rule: 


If  w  <  w 


critical' 


conclude  H 

o 


If  W  -  "critical'  reject  Ho'  accept  H1 

The  ^critical  va^ue  depended  upon  the  critical 
sum  of  squares  value  s  for  15,  ««7  (25:286)  shown  in 
Appendix  D. 

The  critical  s  value  is: 

s  *  864.9 

w  a  Scritical 

critical  i/i2k2(N3-N) 

»  864.9 

6300 

“critical  *  -,373 

The  critical  w  of  .1373  is  the  point  of 
statistical  significance  for  *»15  and  w»7  at  .05 
significance.  Below  this  value,  w  indicates  that  there 
is  no  significant  deviation  from  0,  i.e.,  the  rankings 
are  independent.  For  w  equal  to  or  greater  than  this 
value,  there  is  significant  deviation  from  0,  i.e., 
rankings  are  not  independent  and  some  underlying 
agreement  process  is  active.  The  decision  rules  were 
thus  established: 

If  W  <  .1373,  conclude  H 

o 


If  W  >  .1373,  reject  H  ,  accept  H. 


The  Rj  having  been  derived  from  the  basic  data  in 
Appendix  G,  the  mean  of  all  Rj  was  determined: 

ZRj/N  =  (81  +  53  +  43  +  44  +  61  +  51  +  87)/7 
-  420/7 

ZR./N  =  60 

Next,  the  mean  was  subtracted  from  each  r_.i 
(81-60)  =  21 
(53-60)  -  -  7 
(43-60)  -  -17 
(44-60)  =  -16 
(61-60)  -  1 
(51-60)  =  -  9 
(87-60)  -  27 


Each  deviation  was  then  squared: 
(21 ) 2  -  441 
(-7) 2  -  49 

(-17) 2  -  289 
(-16) 2  -  256 
(D2  *  1 

(-9) 2  -  81 

(27) 2  -  721 
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The  squares  were  then  summed  to  obtain  s: 


s  «  (441  +  49  +  289  +  256  +  1  +  81  +  721) 
-  1846 

w  was  then  computed  using  the  denominator 
previously  derived: 


w 

w 


_ s _ 

1/1 2k2 (N3-N) 
1846 
6J50 


W  -  .2930 


Given : 

If  W  <  .1373,  conclude  H 

o 

If  W  >  .1373,  reject  HQ,  accept  H1 
W  -  .2930  >  .1373 

As  a  result  of  w  being  greater  than  wcr±tical' 
it  was  concluded  to  reject  the  null  hypothesis  that  there 
is  no  agreement  and  to  accept  the  alternate  that  there 
is  agreement. 
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CHAPTER  V 


CONCLUSIONS  AND  RECOMMENDATIONS 

The  research  described  in  the  previous  chapters 
was  performed  with  two  objectives:  to  identify  factors 
that  contribute  to  successful  communication  in  FSED 
Statements  of  Work  and  to  determine  if  there  was  any  agree¬ 
ment  of  factor  order.  Some  conclusions  concerning  the 
contributions  of  the  research  toward  these  objectives  are 
provided  in  this  chapter.  Also  provided  are  some  recommend¬ 
ations  for  the  further  development  and  application  of  the 
research  results. 

Research  Question  Conclusions 

The  ASD  experts,  individually,  provided  twenty-five 
factors  that  contribute  to  successful  communication  in 
FSED  SOWs.  These  twenty-five  responses  are  representative 
but  not  exhaustive,  constrained  in  number  by  the  research 
design.  There  are  certainly  others  that  are  important  to 
successful  SOW  communication. 

The  twenty-five  factors  focus  attention  on  seven 
primary  subjects:  the  requirements  described  by  the  SOW, 
the  consistency  of  the  SOW,  the  internal  organization  of  the 
SOW  document,  cross-referencing  of  the  SOW  to  other  contract 
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documents,  SOW  language  clarity,  the  participation  of  the 
contractor  in  SOW  preparation,  and  the  effort  of  the 
Government  team  tasked  with  the  development  and  writing  of 
the  SOW.  These  are  major  areas  of  concern  that  must  be 
accounted  for  in  the  writing  of  FSED  SOWs  if  the  SOWs  are  to 
communicate  successfully.  They  must  be  considered  by  all 
functional  representatives  engaged  in  FSED  SOW  development 
and  writing. 

All  DOD  system  FSED  programs  have  characteristics 
common  to  those  of  ASD.  All  are  managed  under  the  DOD  5000 
series  of  directives  and  contracted  for  in  accordance  with 
the  Defense  Acquisition  Regulation.  Because  all  FSED  sows 
must  meet  these  general  imperatives,  the  seven  major  areas 
of  concern  should  be  considered  in  acquisition  organizations 
DOD-wide . 

Research  Hypothesis  Conclusions 

The  Research  Hypothesis  that  there  is  agreement  as 
to  the  importance  of  the  factors  identified  was  supported. 
The  Kendall  Coefficient  of  Concordance  test  demonstrated 
that  agreement  between  the  SOW  experts  was  significantly 
greater  than  random. 

The  presence  of  agreement  between  the  experts 
supports  a  position  that  some  of  the  seven  major  areas  of 
concern  have  greater  impacts  on  successful  SOW  communication 
them  others. 


Corollary  Conclusions 

The  order  of  importance  to  successful  SOW 
communication  of  the  seven  major  areas  of  concern  is  pointed 
to  by  the  rankings  received  in  the  Research  Hypothesis  data 
collection  (Appendix  G) . 

With  exceptions,  the  area  of  contractor  participation 
in  SOW  preparation  received  the  lowest  numerical  ratings, 
showing  general  agreement  that  this  is  the  least  important 
factor  contributing  to  successful  SOW  communication.  SOW 
cross-referencing  received  the  next  lowest  marks. 

Clarity  of  language  and  requirements  description 
received  the  highest  rankings,  indicating  their  perceived 
importance  to  successful  SOW  communication. 

While  these  rankings  suggest  relative  importance 
between  the  areas  of  concern,  the  ordinal  nature  of  the 
data  gives  no  suggestion  of  how  much  more  important  one 
area  is  than  another.  While  the  areas  probably  should  be 
emphasized  differently  in  SOW  preparation,  this  does  not 
mean  that  some  should  be  considered  and  others  not. 

Recommendations 

Field  Implementation.  A  knowledge  of  the  major  areas  of 
concern  to  successful  FSED  SOW  communication  would  be 
beneficial  to  all  personnel  engaged  in  SOW  preparation.  It 
is  recommended  that  the  seven  major  areas  of  concern  be  given 
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as  wide  a  dissemination  as  possible.  This  would  include 
publication  as  an  open  letter,  professional  journal 
submission,  addendum  to  current  SOW  writing  instructions, 
and  discussion  in  acquisition  seminars. 

For  SOW  communication  to  increase  in  success, 
personnel  who  engage  in  SOW  preparation  must  not  only  be 
aware  of  the  areas  of  concern,  they  must  implement  them 
as  criteria  against  which  SOWs  are  written.  It  is 
recommended  that  program  managers  and  supervisors  promote 
the  consideration  of  these  areas  during  SOW  preparation 
and  establish  controls  to  insure  that  the  areas  are 
considered  during  SOW  preparation. 

It  is  further  recommended  that  all  areas  of  concern 
be  emphasized.  While  there  is  an  implication  that  some 
areas  are  more  important  than  others,  the  extent  of  the 
difference  in  importance  is  not  known.  It  is  known,  however, 
that  all  seven  areas,  in  some  measure,  contribute  to 
successful  communication  in  FSED  SOWs. 

Recommendations  for  Future  Research.  While  this  research 
was  undertaken  to  provide  practical  information  for  use 
in  developing  and  writing  FSED  SOWs,  it  was  also  under¬ 
taken  as  a  starting  point  for  future,  more  statistically 
definitive  SOW  research.  Replications  of  this  research  at 
other  acquisition  organizations  are  recommended. 
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Replication  would  provide  validation  of  the  techniques 
employed  in  this  research  as  well  as  additional  insight 
into  factors  affecting  successful  SOW  communication. 

Future  research  is  recommended  to  establish  the 
relative  importance  of  SOW  communication  factors.  Such 
research  could  demonstrate  which  factors  should  be 
emphasized  most  during  SOW  development  and  writing. 

A  related  research  area  would  be  the  effects  of  individual 
factors  upon  each  other;  i.e.,  correlation  between  factors. 
Knowledge  of  factor  inter-effects  would  provide  greater 
predictability  of  overall  communication  success  when 
individual  factors  are  emphasized. 

Also  recommended  is  research  into  ways  to  quantify 
and  validly  measure  individual  factors  and  overall 
communication  success.  This  would  provide  techniques 
needed  to  quantitatively  evaluate  individual  SOWs  for 
communication  effectiveness. 

Finally,  research  should  be  performed  to  determine 
the  applicability  of  FSED  SOW  communication  factors  to 
SOW  development  and  writing  in  other  phases  of  system 
acquisition.  Such  research  may  result  in  broader 
applications  for  the  factors  identified  in  this  research, 
or  in  new  factors. 
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Concluding  Comments 

It  is  not  expected  that  the  results  of  this 
research  will  provide  distinct  solutions  to  the  problem 
of  SOW  communication.  It  is  hoped,  however,  to  provide 
system  acquisition  personnel  with  an  impetus  to  consider 
critically  the  FSED  SOWs  that  they  currently  write  and 
use,  and  to  recognize  the  liability  of  SOWs  that  fail  to 
communicate  successfully.  It  is  also  hoped  that  this 
research  will  provide  a  point  of  departure  for  expanded 
research  in  a  topic  area  of  very  little  formal  knowledge. 
As  long  as  Statements  of  Work  fail  to  successfully 
communicate  Government  requirements,  problems  will  arise 
with  accompanying  loss  of  resources  and  opportunity. 
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52021 

45406 

37945 

75234 

24327 

86978 

22644 

139 

78755 

47744 

43776 

83098 

03225 

14281 

83637 

140 

25282 

69106 

59180 

16257 

22810 

43609 

12224 

141 

11959 

94202 

02743 

86847 

79725 

51811 

12998 

142 

11644 

13792 

98190 

01424 

30078 

28197 

55583 

143 

06307 

97912 

68110 

59812 

95448 

43244 

31262 

144 

76285 

75714 

89585 

99296 

52640 

46518 

55486 

145 

55322 

07598 

39600 

60866 

63007 

20007 

66819 

146 

78017 

90928 

90220 

92503 

83375 

26986 

74399 

147 

44768 

43342 

20696 

26331 

43140 

69744 

82923 

148 

25100 

19336 

14605 

86603 

51680 

97678 

24261 

149 

83612 

46623 

62876 

85197 

07824 

91392 

5S3I7 

150 

41347 

81666 

82961 

60413 

71020 

83658 

02415 

J 

j 

j 
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APPENDIX  B 


RESEARCH  QUESTION  INTERVIEW  GUIDE 


I.  Respondent  preparation 

A.  Assure  respondent  of  confidentiality. 

B.  Review  research  purpose  and  benefits. 

1 .  Much  empirical  knowledge  of  PSED  SOW 
communication  exists  but  very  little 
researched  knowledge  exists. 

2.  Research  will  provide  opportunities  for 
improved  future  SOW  writing. 

C.  Define  research  terms. 

1.  Successful  SOW  communication. 

2.  Unsuccessful  SOW  c^/jamunication . 

D.  Establish  response  parameters. 

1 .  Focus  on  PSED  SOWs . 

2.  Focus  on  SOW  attributes  which  positively 
contribute  to . successful  SOW  communication. 

3.  Focus  on  attributes  that  could  affect  FSED 
SOWs  in  general. 

E.  Clarify  respondent  misunderstanding/answer 

respondent  questions. 


II.  Respondent  query. 

A.  Ask  central  question:  "What  factors,  characteristics 
and  qualities  contribute  to  successful  FSED  SOW 
communication? " 


B.  Assist  respondent  when  necessary 


1 .  Probe  respondent  FSED  experience  if 
responses  focus  on  attributes  that: 

(a)  Inhibit  successful  SOW  communication. 

(b)  Contribute  to  unsuccessful  SOW 
communication . 

(c)  Inhibit  unsuccessful  SOW  communication. 

C.  Record  correctly  formatted  responses. 

D.  Assure  respondent  agreement  with  final  written 
response. 

III.  Respondent  post-query. 

A.  Reassure  respondent  of  confidentiality. 

B .  Thank  respondent . 
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KENDALL  COEFFICIENT  OF  CONCORDANCE  W  METHOD 
(For  Signif icance  Tests  at  .05) 

1 .  Let  w  equal  the  number  of  entities  to  be  ranked  and 
let  k  equal  the  number  of  raters  assigning  ranks.  Arrange 
observed  ranks  in  a  *  x  n  matrix. 

2.  For  each  entity,  determine  R_.  ,  the  sum  of  the  ranks 
assigned  to  that  entity  by  the  k  raters. 

3.  Determine  the  mean  of  all  R^:  (Zr^/n). 

4.  Subtract  the  mean  from  each  R  . . 

5.  Square  the  resultant  deviations  from  the  mean. 

6.  Sum  the  squared  deviations  to  obtain  s. 

7.  Determine  w  using  the  following  formula: 


8.  Test  the  observed  Wi 

a.  If  v  <.7,  refer  to  the  table  (25:286)  for  the 

critical  sum  of  squares  s  value  for  the  appropriate  k  and  w 

combination  at  .05  significance.  Compute  the  critical  w 

value  and  test:  If  w  >  w  ,,  there  is  a  significant 

critical  ^ 

agreement.  If  w  <  wcriticai'  no  significant  agreement  can 
be  identified. 


b.  If  »  >7,  compute  the  following  x2  approximation: 

X2  =  k(N-1)W 

Refer  to  the  table  of  significant  values  for  x2  (25:249). 

If  the  computed  x2  is  found  to  be  associated  with  a  significance 
(a)  of  .05  or  less,  there  is  significant  agreement?  if  greater 
than  .05,  no  significant  agreement.  (25:229-238) 
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Table  or  Critical  Values  of  >  in  tbs  Kendall  Coefficient 
or  Concohdance* 


k 

y 

Additional  values 
for  iV  -  3 

_ 

3t 

4 

5 

6 

7 

i 

k  | 

« 

Values  at  the  .05  level  of  significance 


3 

64.4 

103.9 

157.3 

9  1 

54.0 

4 

49.5  ! 

88.4 

143.3 

217.0 

12 

71.9 

5 

62.6 

112.3 

182.4 

276.2 

14 

83.3 

6 

75.7 

136.1 

221.4 

335.2 

16 

95.8 

8 

48.1 

101.7 

183.7 

299.0 

453.1 

18 

107.7 

10 

60.0 

127.8 

231.2 

376.7 

571.0 

15 

89.8 

192.9 

349.8 

570.5 

864.9 

20 

119.7 

258.0 

468.5 

764.4 

1,153.7 

Values  at  the  .01  level  of  significance 


3 

75.6 

■Bl 

185.6 

9 

75.9 

4 

61.4 

109.3 

265.0 

12 

103.5 

5 

80.5 

142.8 

229.4 

343.8 

14 

121.9 

6 

99.5 

176.1 

282.4 

422.6 

16 

140.2 

8 

66.8 

137.4 

242.7 

388.3 

579.9 

18 

158.6 

10 

85.1 

175.3 

BkH 

494.0 

737.0 

15 

131.0 

269.8 

475.2 

758.2 

1,129.5 

20 

177.0 

364.2 

641.2 

1,022.2 

1,521.9 

*  Adapted  from  Friedman,  M.  1940.  A  comparison  of  alternative  tests  of  sig¬ 
nificance  for  the  problem  of  m  rankings.  Ann.  Math.  Statist.,  11,  86-92,  with  the 
kind  permission  of  the  author  and  the  publisher. 

t  Notice  that  additional  critical  values  of  i  for  iV  »  3  are  given  in  the  right-hand 
column  of  this  table. 
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APPENDIX  E 


RESEARCH  HYPOTHESIS  CODING  RESULTS 


Requirements 

1.  Clear,  unambiguous  definition  of  requirements. 

2.  Sincere,  realistic  requirements. 

3.  Critical  requirements  distinguished  from  non- 
critical  requirements. 

4.  Variable  (trade-off)  requirements  distinguished 
from  absolute  requirements. 

6.  Incorporated  documents  tailored  to  requirements. 

21.  Individual  functional  office  comprehension  of 
program  objectives  and  requirements. 

Consistency 

7.  Written  terminology  consistent. 

8.  SOW  statements  non-contradictory. 

Internal  Document  Organization 

9.  Easy  to  read/use  paragraph  numbering  system. 

10.  Consistent  format  and  organization  in  SOW  document. 

11.  SOW  logically  organized. 

Contract  Cross-Referencing 

12.  SOW  paragraphs  reference  Contract  Data  Requirements 
List  (CDRL) 

13.  SOW  paragraphs  reference  other  contract  documents. 
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Language 

5.  Graphics/visual  descriptions  used  when  appropriate. 

14.  Terms  and  acronyms  defined. 

15.  Concise  language. 

16.  Clear,  precise  language. 

Contractor  Participation 

17.  Draft  SOW  reviewed  and  commented  on  by  Contractor. 

18.  Government-Contractor  interchange  meetings  held 
concerning  draft  SOW. 

Government  Personnel  Team  Effort 

19.  Development/writing  of  SOW  accomplished  by 
integrated  Government  effort. 

20.  Leadership  of  SOW  writing  effort. 

22.  SOW  reviewed  by  Government  contracts  office. 

23.  Internal  Government  review  of  SOW. 

24.  User  agency  participation  in  SOW  development/ 
writing . 

25.  Program  manager  guidance  to  the  Acquisition 
team. 
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PSED  STATEMENT  OF  WORK  PRIORITY  SURVEY 


A  few  weeks  ago,  you  and  several  other  people  were 
interviewed  and  asked  for  your  opinions  of  factors, 
characteristics,  and  qualities  that  contribute  to  success¬ 
ful  PSED  Statement  of  Work  communication*.  These 
interviews  provided  a  number  of  general  SOW  communication 
factors. 

Below  are  seven  statements  about  different  SOW 
communication  factors.  Please  read  them  and  rank  them 
in  the  order  that  you  feel  they  are  important  to 
successful  SOW  communication.  Rank  them  1_  through  7, 
with  1_  as  the  most  important,  in  the  spaces  provided 
at  the  right  of  each  statement.  (They  have  been 
randomly  arranged  on  the  page;  their  order  of  appearance 
has  no  bearing  on  their  importance.)  Please  read  all 
seven  before  ranking  them. 

1 .  Individual  SOW  paragraphs  are  referenced 

with  related  requirements  in  other  documents .  _ 

2.  The  organization  of  the  SOW  document  is 

logical  and  consistent.  _ 

3.  The  SOW  is  written  in  clear  language.  _ 

4.  The  SOW  requirements  are  realistic 

and  unambiguous  with  allowable  requirement 
variations  clearly  defined.  _ 

5.  The  writing  and  review  of  the  SOW  is 

accomplished  under  program  office  manage¬ 
ment  by  representatives  of  functional 
disciplines  and  program-related  agencies.  _ 

6.  The  terms  and  statements  in  the  SOW 
are  consistent  and  compatible. 

7.  The  Contractor  is  afforded  the  oppor¬ 
tunity  to  review  and  comment  on  the  draft 
SOW. 


*  SUCCESSFUL  SOW  COMMUNICATION  is  an  event  that  occurs 
when  the  Government  requirements  transmitted  by  the  SOW 
are  received  and  interpreted  by  the  Contractor  as  the 
Government  intended,  and  Government-contractor  under¬ 
standing  and  agreement  are  established. 


59 


SELECTED  BIBLIOGRAPHY 


t 


A.  REFERENCES  CITED 


Acquisition  Logistics  Division,  Directorate  of 
Product  Performance  Evaluation,  AFALD/PPE, 
Wright-Patterson  AFB  OH.  "AFALD  Lessons  Learned 
File."  Unnumbered  computerized  data  base. 

Air  Force  Systems  Command.  Contracting  Practices. 

AFSC  Regulation  550-22.  Andrews  AFB  MD, 

6  December  1978. 

Boykin,  J.  Arthur.  Consultant  to  ASD/AV.  Briefing, 
subject:  Program  for  Improvement  of  RFPs.  — 

Related  Documents/Activities  Emphasizing  Other 
than  Major  Systems,  to  ASD  Organizations,  1976. 

_ •  Consultant  to  ASD/AV,  Wright-Patterson  AFB 

OH.  Personal  interview.  9  October  1979. 

Brechtel ,  Captain  Donald  L.,  USAF,  and  Captain  Steven 
C.  Lathrop,  USAF.  "A  Comparative  Analysis  of  the 
Application  of  Production  Readiness  Reviews." 
Unpublished  master's  thesis.  SLSR  2-76B,  AFIT/LS, 
Wright-Patterson  AFB  OH,  September  1976.  AD  A032456. 

Emory,  C.  William.  Business  Research  Methods. 

Homewood  IL:  Richard  D.  Irwin,  Inc., 1976. 

Esposito,  Brigadier  General  A.L.,  USAF.  "An  Analysis 
of  Frustration:  The  RFP-Proposal  Cycle,"  Defense 
Management  Journal,  IX,  No.  1,  (January  197 j), 
pp.  8-12. 

Falleur ,  J.D.,  Chairman,  Contract  Review  Committee, 
ASD/PMC ,  Wright-Patterson  AFB  OH.  Personal 
interview.  12  September  1979. 

Fox,  J.  Ronald.  Ajnning  America:  How  the  U.S.  Buys 
Weapons .  Cambridge  MA:  Harvard  University  Press, 


63 


10. 


Howe,  Herbert  J.  Procuring  Contracting  Officer,  Space 
Systems  Division,  AFSC,  Los  Angeles  CA.  Staff 
Study,  subject:  Work  Statement  Writing.  February 
1963. 

11.  _ .  Procuring  Contracting  Officer,  Space 

Systems  Division,  AFSC,  Los  Angeles  CA.  Draft 
Work  Statement  Guide.  15  January  1964. 

12.  _ .  Procuring  Contracting  Officer,  Space  and 

Missile  Systems  Organization,  AFSC,  Los  Angeles 
CA.  Partial  Draft  SAMSO  R6D  Buyer's  Handbook. 
Circa  1972. 

13.  _ .  Chief,  Contract  Administration  Division, 

AFPRO,  AFCMD  Detachment  28,  General  Electric 
Company,  Evendale  OH.  Written  Summary,  subject: 
Suggested  Areas  for  Improvement  of  Systems 
Procurement,  10  October  1975. 

14.  _ .  Chief,  Contract  Administration  Division, 

AFPRO,  AFCMD  Detachment  28,  General  Electric 
Company,  Evend&le  OH.  Personal  interview. 

26  September  1979. 

15.  Hynes,  Cecil  V.  "Purchase  Communications:  A  study  of 

the  Request  for  Proposal.”  Unpublished  research 
report,  unnumbered,  College  of  Business  and 
Management,  University  of  Maryland,  College  Park 
MD,  June  1976.  LD  36879A. 

16.  Lathrop,  Captain  Steven  C.,  USAF.  Instructor, 

Department  of  Contracting  Management,  AFIT/LS, 
Wright-Patterson  AFB  OH.  AFIT  course  CM5.23, 
"Contracting  and  Acquisition  Management,"  Class 
1980.  Lectures  and  intermittent  personal 
interviews.  August  1979  through  May  1980. 

17.  Morris,  Steele.  "Communications  Effectiveness  Needed 

In  RFP-Proposal-Communication  Award  Cycle," 
Defense  Management  Journal,  IX,  No.  1,  (January 
1573) ,  'pp.  17-25. - 

18.  Nachmias,  David  and  Chava  Nachmias.  Research  Methods 

in  the  Social  Sciences.  New  York:  St.  Martin's 
Press,  1976. 


64 


19.  Neter,  John,  William  Wasserman,  and  G.A.  Moore. 

Allied  Statistics.  Boston:  Allyn  and  Bacon,  Inc. 

20.  Rail,  Frederick  T.,  Jr.  Technical  Director,  ASD/EN. 

Letter,  subject:  Newsletter:  Preparation  of 
Statements  of  Work,  to  ASD  Chief  Engineers, 

4  May  1977. 

21.  Robinson,  Donald  W.  Chief,  Contracting  Policy  Division, 

ASD/PMH,  Wright-Patterson  AFB  OH.  Personal 
interview.  10  September  1979. 

22.  Rogers,  Major  Glenn,  USAF.  "A  Study  of  Request  for 

Proposal  Improvements."  Unpublished  study. 

Assistant  for  Acquisition  Management,  ASD/AV, 
Wright-Patterson  AFB  OH,  August  1977. 

23.  Schaeffer,  James  A.  Acting  Assistant  Deputy  for 

Procurement  and  Production,  ASD/PP.  Letter, 
subject:  Statements  of  Work,  to  ASD  buying 
activities,  15  September  1976. 

24.  Selltiz,  Clair,  Marie  Jahoda,  Morton  Deutsch,  and 

Stewart  W.  Cook.  Research  Methods  in  Social 
Relations.  Vol.  1.  New  York:  Holt,  Rinehart 
and  Winston,  1964. 

25.  Siegel,  Sidney.  Nonparametrlc  Statistics  for  the 

Behavioral  Sciences.  New  York:  McGraw-Hill 
Book  Company,  Inc.,  1956. 

26.  United  Research  Incorporated.  Report  of  Work 

Statement  Field  Survey.  Contract  DA-49-186 -AMC- 
£92 tx) .  Washington ,  D . C . ,  30  June  1966. 

LD  10892. 

27.  U.S.  Department  of  Defense.  Defense  Acquisition 

Regulation.  Section  IV:  "Special  Types  and 
Methods  of  Procurement."  Washington:  Government 
Printing  Office,  1976. 

28.  __ Major  System  Acquisitions.  DOD  Directive 

5o66.1 .  Washington:  Government  Printing  Office, 

18  January  1977. 


65 


29.  Williams,  Robert  F.,  Paul  F.  Arvis,  and  Kenneth  D. 

Griffiths.  "Developing  Guidance  for  the  Preparation 
of  Requests  for  Proposal."  Unpublished  research 
report  No.  PRO-401,  U.S.  Army  Procurement  Research 
Office,  Institute  of  Logistics  Research,  Army 
Logistics  Management  Center,  Fort  Lee  VA,  December 
1973.  AD  778  189. 


B.  RELATED  SOURCES 

Aeronautical  Systems  Division  (AFSC) .  Purchase  Request. 
PPM  Operating  Instruction  70-1.  Wright-Patterson  AFB 
OH,  20  October  1977. 

Air  Force  Systems  Command.  Work  Statement  Preparation . 
AFSCM  70-5.  Washington:  Government  Printing  Office, 

1  February  1968. 

_ .  Statement  of  Work  Preparation  Guide.  AFSC 

Pamphlet  800-6.  Washington:  Government  Printing 
Office,  18  August  1972. 

_ .  Laboratory  Program  Managers  Guide,  Part  I, 

Statement  of  Work  Preparation.  Andrews  AFB  MD, June 

T5T1T -  - - 

Boykin,  J.  Arthur.  Consultant  to  ASD/AV.  Briefing, 
subject:  Claims  Against  the  Government,  to  ASD 
organizations . 

Flynn,  John  Thomas.  "The  Rule  Contra  Preferentum  in 
the  Government  Contract  Interpretation  Process . " 
Unpublished  master's  thesis.  CI-77-88,  AFIT/CI, 
Wright-Patterson  AFB  OH,  August  1977.  AD  A046813. 

Kelly,  Albert  J.  "Can  Weapon  System  Procurement  Be 
Managed,"  Defense  Systems  Management  Review,  I, 

No .  4  (Autumn  1977),  pp  1-5. 

Mahoy,  James  0.,  ed.  Government  Contract  Law.  Maxwell 
AFB  AL,  1979. 

Miley,  Brigadier  General  Henry  A.,  USA.  Director 
of  Procurement  and  Production,  HQ  U.S.  Army 
Materiel  Command,  Washington  D.C.  Letter, 
subject:  Preparation  of  Request  for  Proposals 
and  Work  Statements,  to  AMC  Major  Subordinate 
Commands,  21  March  1966. 


Peat  Marwick  Management  Systems  Co.  Lessons  Learned 
From  Contract  Definition.  Report  prepared  for 
OSD/DDRSE.  Boston  MA.  August  1965.  AD  468398. 

Slonim,  Morris  J.  Sampling  in  a  Nutshell.  New  York: 
Simon  and  Schuster,  Inc.,  1960. 

Stewart,  Lieutenant  General  James  T.,  USAF.  "Source 
Selection  Process  Faces  Winds  of  Change," 

Defense  Management  Journal,  IX,  No.  1,  (January 
1973),  pp.  13-16. 


U.S.  Department  of  Defense.  Office  of  the  Director  of 
Defense  Research  and  Engineering.  Defense  Science 
Board  Task  Force  on  R6D  Management.  Final  Report 
on  Systems  Acquisition.  Washington,  D.C.,  31  July 
TStfd.  LD  29991 . 


67 


